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. Abstract 

pH , The flag-major index "fmaj" and the classical length function "£" are used to 

construct two (/-analogs of the generating polynomial for the hyperoctahedral 
group B n by number of positive and negative fixed points (resp. pixed points). 
Specializations of those (/-analogs are also derived dealing with signed derange- 
ments and desarrangements, as well as several classical results that were previ- 
ously proved for the symmetric group. 



1. Introduction 



> 

■ The statistical study of the hyperoctahedral group B n , initiated by 

Reiner ([Re93a], [Re93b], [Re93c], [Re95a], [Re95b]), has been rejuvenated 
by Adin and Roichman [AR01] with their introduction of the flag-major 
index, which was shown [ABR01] to be equidistributed with the length 
^ ■ function. See also their recent papers on the subject [ABR05], [ReRo05]. 

It then appeared natural to extend the numerous results obtained for the 
symmetric group & n to the groug B n . Furthermore, flag-major index and 
length function become the true g-analog makers needed for calculating 
various multivariable distributions on B n . 
$_i ■ In the present paper we start with a generating polynomial for B n by a 



three-variable statistic involving the number of fixed points (see formula 
(1.3)) and show that there are two ways of ^-analogizing it, by using the 
flag-major index on the one hand, and the length function, on the other 
hand. As will be indicated, the introduction of an extra variable Z makes 
it possible to specialize all our results to the symmetric group. Let us first 
give the necessary notations. 

Let B n be the hyperoctahedral group of all signed permutations of 
order n. The elements of B n may be viewed as words w = X\X2 • ■ ■ x n , 
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where each Xi belongs to {— n, . . . , —1, 1, . . . , n} and \x\ \\x2\ ■ 
permutation of 12 ... n. The set (resp. the number) of negative letters 
among the x^s is denoted by Negw (resp. negio). A positive fixed point 
of the signed permutation w = X\X2 • • • x n is a (positive) integer i such 
that Xi = i. It is convenient to write % := —i for each integer i. Also, 
when A is a set of integers, let A := {i : i G A}. If Xi = % with % positive, 
we say that % is a negative fixed point of w. The set of all positive (resp. 
negative) fixed points of w is denoted by Fix" 1 " w (resp. Fix - w). Notice 
that Fix - w C Negw. Also let 

(1.1) fix" 1 " w := # Fix" 1 " w; fix - w := # Fix - w. 

There are 2 n nl signed permutations of order n. The symmetric group @ n 
may be considered as the subset of all w from B n such that Negw = 0. 

The purpose of this paper is to provide two q- analogs for the polyno- 
mials B n (Yo, Y"i, Z) defined by the identity 



^ n\ exp(w(l + Z)) 

When Z = 0, the right-hand side becomes (1 — -u) -1 exp(uY )/ exp(u), 
which is the exponential generating function for the generating polyno- 
mials for the groups & n by number of fixed points (see [Ri58], chap. 4). 
Also, by identification, B n (l, 1, 1) = 2 n n! and it is easy to show (see The- 
orem 1.1) that B n (Yo,Y]_, Z) is in fact the generating polynomial for the 
group B n by the three- variable statistic (fix + , fix - , neg), that is, 

(1.3) B n (Y ,Y l ,Z)= ^ yfa + »yfix-» r g« 

w€B n 

Recall the traditional notations for the g-ascending factorials 

A \ ( \ _ / 1, if n = 0; 

1 > WQin'— \(i- a )(l-aq)---(l-aq n - 1 ), ifn>l; 

n>l 

for the (/-multinomial coefficients 

(1.5) ' := t r ( g,g ) n — (mH hm fc =n); 

mi,...,m fc J g {q;q)m 1 ---{q;q) mk 

and for the two (/-exponentials (see [GaRa90, chap. 1]) 

. , . . x - u n 1 t . « x - q^)u n . , 
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Our two (/-analogs, denoted by £ B n (q, Y , Yi, Z) and B n (q, Yq, Yi, Z), 
are respectively defined by the identities: 



n>0 



^ (-Zq;q) n (q;q) n ) 

( L8 ) E^ 5 ^ 9 ' 70 ' 71 '^ 

n -° ' " = / u l + gZ N-i^ (^;q 2 )oq (-^YiZjg 2 )^ 
V 1-g 2 / (wY"o;? 2 )oo (-uqZ^q 2 )^ 

Those two identities can be shown to yield (1.2) when q = 1. 

There is also a graded form of (1.8) in the sense that an extra 
variable t can be added to form a new polynomial B n (t, q, Yq, Yi, Z) with 
nonnegative integral coefficients that specializes into B n (q, Yq, Yi, Z) for 
t = 1. Those polynomials are defined by the identity 



(t 2 ;g 2 )n+i 



(1.9) £(i + *)B n (t,g,y ,yi,z) 

n>0 

= y ^ ( i _ u y g i^x(< odd) \ - x x (m; 9 2 ) Ls /2J+i (-^qYiZ; Q 2 ) L ( s+1)/2 j 
^ ^ ^ ' (uY ;q 2 ) [s/2i+1 (-uqZ;q 2 ) [(s+1)/2i 

where for each statement A we let x( A) = 1 or depending on whether A 
is true or not. The importance of identity (1.9) lies in its numerous 
specializations, as can be seen in Fig. 1. 

The two (/-extensions e B n (q, Yq, Y\, Z) and B n (t, q, Yq, Yi, Z) being now 
defined, the program is to derive appropriate combinatorial interpretations 
for them. Before doing so we need have a second combinatorial interpreta- 
tion for the polynomial B n (Y , Y 1 , Z) besides the one mentioned in (1.3). 
Let w = x\X2 bea word, all letters of which are integers without any 

repetitions. Say that w is a des arrangement if x\ > X2 > ■ • • > x^k and 
X2k < X2k+i for some k > 1. By convention, Xn+i = oo. We could also say 
that the leftmost trough of w occurs at an even position. This notion was 
introduced by Desarmenien [De84] and elegantly used in a subsequent 
paper [DeWa88]. Notice that there is no one-letter desarrangement. By 
convention, the empty word e is also a desarrangement. 

Now let to = X1X2 ■ • ■ x n be a signed permutation. Unless w is increasing, 
there is always a nonempty right factor of w which is a desarrangement. 
It then makes sense to define w d as the longest such a right factor. 
Hence, w admits a unique factorization w = w~w + w d , called its pixed^ 

t 1 ) "Pix," of course, must not be taken here for the abbreviated form of "pictures." 
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factorization, where w~ and w + are both increasing, the letters of w~ 
being negative, those of w + positive and where w d is the longest right 
factor of w which is a desarrangement. 

For example, the pixed factorizations of the following signed permuta- 
tions are materialized by vertical bars: u; = 52|e|341;«; = 5|e|2314; 
«; = 532 | 14 | e; w = 53|l|42; w = 5 3 | e | 4 1 2. 

Let w = w~w + w d be the pixed factorization of w = x\Xi- • ■ x n . 
If w~ = x\---Xk, w + = Xk+i---Xk+i, define Pix~ w := {xi,...,Xk}, 
Pix + w := {xk+i, ■ ■ ■ , Xk+i}, pix~ w := # Pix~ w, pix + w := # Pix + w. 

Theorem 1.1. The polynomial B n (Y , Y\, Z) defined by (1.2) admits the 
following two combinatorial interpretations: 

B n (Y , Y 1 ,Z) = J2 Y i X ~ W Y 2 X+ W zneg W = Y1 Y ? 1X ~ W y 2 PiX+ W Z negw . 

Theorem 1.1 is proved in section 2. A bijection <p of B n onto itself will be 
constructed that satisfies (Fix - , Fix + , Neg) w = (Pix~, Pix + , Neg) 4>(w). 

Let "f be the length function of B n (see [Bo68, p. 7], [Hu90, p. 12] 
or the working definition given in (3.1)). As seen in Theorem 1.2, 
u £ n is to be added to the three- variable statistic (pix + , pix~, neg) (and 
not to (fix + , fix - , neg) ) for deriving the combinatorial interpretation of 
e B n (q, Y , Yi,Z). This theorem is proved in section 3. 

Theorem 1.2. For each n > let £ B n (q, Yq, Y\, Z) be the polynomial 
defined in (1.7). Then 

(1.10) e B n (q, T , Y u Z)= ^ M y o PiX+ " Y f*~ ™ Z ^ W ■ 

weB n 

The variables t and q which are added to interpret our second extension 
B n (t,q,Y ,Y 1 , Z) will carry the flag-descent number "fdes" and the flag- 
major index "fmaj." For each signed permutation w = x\Xi- ■ • x n the 
usual number of descents "des" is defined by desw := ^7=1 x( x i > x i+i)i 
the major index "maj" by maj w := * x( x i > x i+i)i the flag descent 

number "fdes" and the flag-major index "fmaj" by 

(1.11) fdesty := 2 desty + x(^i < 0); fmaj w := 2 maj w + neg w. 

Theorem 1.3. For each n > let B n (t, q, Y , Yi, Z) be the polynomial 
defined in (1.9). Then 

(1.12) B n (t, q, Y , Y 1 ,Z)= t Mesw q imai w T fix+ w Y± x ~ w Z negw . 

weB n 
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Theorem 1.3 is proved in Section 5 after discussing the combinatorics 
of the so-called weighted signed permutations in Section 4. Section 6 
deals with numerous specializations of Theorem 1.2 and 1.3 obtained by 
taking numerical values, essentially or 1, for certain variables. Those 
specializations are illustrated by the following diagram (Fig. 1). When 
Z = 0, the statistic "neg" plays no role and the signed permutations 
become plain permutations; the second column of the diagram is then 
mapped on the third one that only involves generating polynomials for & n 
or subsets of that group. 



jjB (fmaj.fix ,neg 



D*{q,Y U Z) 
fdes 

D*{t,q,Y u Z) 

flx+ 

Bnlt.^Yo.Yj.Z) 

fdes 

B n {q,Y ,Y u Z) 



neg 



neg 



neg 



Dn(q) 
des 

D n (t,q) 

fix+ 

A n (t,q,Y ) 



maj 



des 

, ne s A n (q,Y ) 



(fix ,fix+,neg) 
(pix~ ,pix + ,neg) 



fmaj 



maj 



B n (Y ,Y 1; Z) , ne s A n {Y ) 



fix+ 



pix n 



(£,pix ,neg) 



«B n (q,Y ,Yi,Z) 

pix+ 

'KB( q , Yl ,Z) 



neg 



neg 



V A n (q,Y ) 
pix+ 



'K n {q)- 



imaj 



Fig. 1 



D r . 



The first (resp. fourth) column refers to specific subsets of B n (resp. 
of6 n ): 

" Fix + w = Negw = 0}; 
Pix + w 



D r 



(1.13) 



K, 
D 



K, 



{w e B T 
{w E B ri 
{w E B r , 
{w e B r , 



Fix" 1 " W 
Pix + w 



Neg w 

0}; 
0}- 



0}; 



The elements of D n are the classical derangements and provide the 
most natural combinatorial interpretations of the derangement numbers 
d n = #D n (see [Co70], p. 9-12). By analogy, the elements of are called 
signed derangements. They have been studied by Chow [Ch06] in a recent 
note. The elements of K n (resp. of K^) are called des arrangements (resp. 
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signed des arrangements) of order n. When Y = 0, the statistic fix + (resp. 
pix + ) plays no role. We can then calculate generating functions for signed 
(resp. plain) derangements or desarrangements, as shown in the first two 
and last rows. The initial polynomial, together with its two (/-analogs are 
reproduced in boldface. 

2. Proof of Theorem 1.1 

As can be found in ([Co70], p. 9-12)), the generating function for the 
derangement numbers d n (n > 0) is given by 

(2.1) $> n - = (l- W ) -1 e - -. 

n>0 

An easy calculation then shows that the polynomials B n (Y , Y"i, Z), intro- 
duced in (1.2), can also be defined by the identity 

(2.2) B n (Y Q ,Y 1 ,Z) = V ( . n \Y*Yl Z* +k d k+l (n > 0). 

i+j+k+l=n v ' 7 

For each signed permutation w = X\Xi- • ■ x n let A : = Fix + w, B := 
Fix~w, C := Negw \ Fix" w, D := [n] \(AL)BUC). Then (A,B,C,D) 
is a sequence of disjoint subsets of integers, whose union is the interval 
[n] := {1,2, ... ,n}. Also the mapping r defined by r(j) = Xj if j e C 
and r(j) = Xj if j e D is a derangement of the set C + D. Hence, w is 
completely characterized by the sequence (A, B, C, D, r). The generating 
polynomial for B n by the statistic (fix + , fix - , neg) is then equal to the 
right-hand side of (2.2). This proves the first identity of Theorem 1.1. 

Each signed permutation w = X\X2 • • -x n can be characterized, either 
by the four-term sequence (Fix + w, Fix - w, Neg w, r), as just described, or 
by (Pix + w, Pix - w, Neg w, w d ), where w d is the desarrangement occurring 
as the third factor in its pixed factorization. To construct a bijection <fi 
of B n onto B n such that (fix - , fix , neg) w = (pix - , pix + , neg) <j>(w) 
and accordingly prove the second identity of Theorem 1.1, we only 
need a bijection r i— > f(r), that maps each derangement r onto a 
desarrangement /(r) by rearranging the letters of r. But such a bijection 
already exists. It is due to Desarmenien (op. cit). We describe it by means 
of an example. /123456789 



Start with a derangement r = ( nf7/ , QC o«c;i an< ^ express it as a 

yy 74oo2o51y 

product of its disjoint cycles: r = (1 9)(2 76)(34)(5 8). In each cycle, 
write the minimum in second position: r = (9 1) (6 2 7) (4 3) (8 5). Then, 
reorder the cycles in such a way that the sequence of those minima, when 
reading from left to right, is decreasing: r = (8 5) (4 3) (6 2 7) (9 1). The 
desarrangement /(r) is derived from the latter expression by removing 
the parentheses: /(r) = 854362791. 
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Let (Fix + w, Fix" w, Neg w, r) be the sequence associated with the 
signed permutation w and let v~ (resp. v~) be the increasing sequence 
of the elements of Fix - w (resp. of Fix + w). Then, v~ \ v + \ f(r) is the 
pixed factorization of v~v + /(r) and we may define <j>(w) by 

(2.3) (j)(w) :=v~v + f(r). 

This defines a bijection of B n onto itself, which has the further property: 

(2.4) (Fix",Fix + ,Neg)«; = (Pix~, Pix + , Neg) <p(w). 

T7 -.u A23456789\ . . , _ _ ^ 

£or instance, with w = q7To , rTnc^ we bave = 45, u =2, 
/T ^ 7 & Q\ ^3 28451967^/ 

T = = (97)(8613) and /(r) = 978613. Hence, the pixed 



v 38196 7 y 

factorization of <p(w) reads 2 | 45 | 978613 and 0(tw) = 245978613. 

3. Proof of Theorem 1.2 

The length function for i? n is expressed in many ways. We shall use 
the following expression derived by Brenti [Br94]. Let w = x\x^ • • -x n be 
a signed permutation; its length £(w) is defined by 

(3.1) £(w) := inv w + \xj\ %( Xj < 0), 

where "inv" designates the usual number of inversions for words: 
invw := x(xi > Xj). 

l<i<j<n 

The generating polynomial for K n (as defined in (1.13)) by "inv" (resp. 
for D n by "maj") is denoted by K n (q) (resp. D n (q)). As was proved in 
[DeWa93] we have: 

(3.2) K n (q)=D n (q). 
Also 

(3.3) £ 7^-5„( ? ) = (l - -^-) _1 X («; 5)00, 

as shown by Wachs [Wa90] in an equivalent form. Another expression 
for D n (q) will be derived in section 6, Proposition 6.2. 

If A is a finite set of positive integers, let tot A denote the sum a 
(a G A). For the proof of Theorem 1.2 we make use of the following 
classical result, namely that q> Ar ( 7V + 1 V 2 [™] i s equal to the sum ^q totA , 

where the sum is over all subsets A of cardinality N of the set [n] . 
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Remember that each signed permutation w = x\Xi . . . x n is charac- 
terized by a sequence (A, B,C, D,r), where A = Pix + w, B = Pix - w, 
C = Negiu \ B, D = [n] \ (A U B U C) and r is a des arrangement of 
the set C + D. Let inv(S,C) be the number of pairs of integers 
such that i G B, j e C and i > j. As mv(B,C) = inv(C, B), we have 
inv w = mv(B,C) + mv(A, D) + #A x #C + invr. From (3.1) it follows 
that 

£(w) = invw + \xi\ = invw + tot B + totC 

x,<0 

= tot B + tot C + inv(C, B) + inv(A, D) + #ix#C + inv r. 



Denote the right-hand side of (1.10) by G n := G n (q, Yq, Y\, Z). 
We will calculate G n (q, Yq, Yi, Z) by first summing over all sequences 
(A, B, C, D, t) such that #A = i, #B = j, #C = k, #D = I. Accordingly, 
t is a desarrangement of a set of cardinality k + I. We may write: 

q _ gtot B+tot C+inv(C,B)+inv(A,B)+i-fc 



i+j+k+l=n (A,B,C,D) 



xY^Y(Z 3+k Q [nVT 

reK k+i 

_ ^2 ^2 ^2 E g tot E + inv (^)+ inv ( A -- D )+ i - fc 

m+P =n J+k^rn, #S=^ c+B=B, x Y+frZY Z k D k+l {q) 

= E E ^(WW^+k?) 

? tot£ ^ (? inv(C,B)+inv(A,.D) 



m+p=n j+fc=m, 



X 



#E=m, C+B=E, 
F=[n]\E A+D=F 



J2 E Y^ZyiZq^D^iq) 

m+p=n j+k=m 



i+l—p 



X q 



ra(m+l)/2 



n 




m 




P 


m 


9 




9 





Thus 



(3.4) G n = 

i+j+k+l=n 



n 

i, j, k, 



q( 3+ " +1 )Y^Y 1 Zy(Zq^ k D k+l (q). 



Now form the factorial generating function 
G(g,y ,yi,Z; U ) :=Et" 



n>0 



{-Zq;q) n (?;?), 



-G n ( g ,y ,yi,z). 
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It follows from (3.4) that 
G(M ,Z;u) = j: i -J- r £ , 



(q;q)i (q;q)j 



x it 



n-i-j 



D k+l (q)(Zq*) 



i\k 



(q;q)k(q;q)l 
But = + (j + 1)* + (*). Hence 

v v 7 , \- 1 A v- (i+i) (uY o y (uYiZY 



„ > ( z '/ : '/)" „, „, ..,-„ 



X 



u 



(?;?)»-» 



-D n - m (q) 

k+l=n—m 



n — m 

k,l 



(Zq m+1 ) k q(z). 



Now 



and 
Hence 



(-Zq m+1 ;q) n _ m = £ 

k+l=n—m 



n — m 

k,l 



(Zq m+1 ) k q^)- 



(-Zq;q) n = (-Zq;q) m (-Zq m+1 ;q) n - m . 

-D n - m (q) 



n>0 m=0 



(E 

n>0 



a n *u' 



(-Zq;q) n (q; q) n 



n>0 



with 



n 



Vo" £ 

i+j=n 



q 
n 

hi 



Y^){qY 1 Zy 

(qY^YiZyq® 



= Y n (-qY - 1 Y 1 Z;q) n . 

By taking (3.3) into account this shows that G(q, Yo,Y±, Z; u) is equal to 
the right-hand side of (1.7) and then G n {q,Y Q ,Y u Z) = *Bn{q,Y Q ,Y u Z) 
holds for every n > 0. The proof of Theorem 1.2 is completed. By (3.4) 
we also conclude that the identity 



(S.5) e B n (q,Y ,Y 1 ,Z) = Y, 

i+j+k+l=n 



n 

h j-> k-> I. 



q( 3+ " +1 )Y^Y 1 Zy(Zq^ k D k+l (q) 
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is equivalent to (1.7). As its right-hand side tends to the right-hand side 
of (2.2) when q — > 1, we can then assert that (1.7) specializes into (1.2) 
for q = 1. 

4. Weighted signed permutations 

We use the following notations: if c = c\Ci ■ ■ • c n is a word, whose 
letters are nonnegative integers, let A(c) := n be the length of c, tote := 
ci + C2 + • • • + c n the sum of its letters and odd c the number of its 
odd letters. Furthermore, NlW n (resp. NlW n (s)) designates the set of all 
nonincreasing words of length n, whose letters are nonnegative integers 
(resp. nonnegative integers at most equal to s). Also let NlW^(s) (resp. 
DW°(s)) be the subset of NIW n (s) of the nonincreasing (resp. strictly 
decreasing) words all letters of which are even (resp. odd). 

Next, each pair (?) is called a weighted signed permutation of order n 
if the four properties (wspl)-(wsp4) hold: 
(wspl) c is a word c\c^ • ■ • c n from NlW n ; 
(wsp2) w is a signed permutation X1X2 • • -x n from B n ; 
(wsp3) Ck = Cfc+i =^ Xk < Xk+i for all k = 1, 2, . . . , n — 1; 
(wsp4) Xk is positive (resp. negative) whenever Ck is even (resp. odd). 

When w has no fixed points, either negative or positive, we say that (^) 
is a weighted signed derangement. The set of weighted signed permutations 
(resp. derangements) (^) = (^^...x™ ) °^ or( ^ er n ^ s denoted by WSP n (resp. 
by WSD n ). The subset of all those weighted signed permutations (resp. 
derangements) such that c\ < s is denoted by WSP n (s) (resp. by WSD n (s)). 

For example, the following pair 



1 2 


3 


4 5 6 


7 8 9 


10 


11 12 


13 


10 10 


9 


7 7 7 


4 4 4 


3 


2 2 


1 


1 2 


7 


6 5 4 


3 8 9 


10 


12 13 


TT 



w 

is a weighted signed permutation of order 13. It has four positive fixed 
points (1, 2, 8, 9) and two negative fixed points (5, 10). 

Proposition 4.1. With each weighted signed permutation ( c ) from the 
set WSP n (s) can be associated a unique sequence k, (^,), v e 7 v°) such 
that 

(1) i, j, k are nonnegative integers of sum n; 

(2) ( ,J is a weighted signed derangement from the set WSDi(s); 

(3) v e is a nonincreasing word with even letters from the set NIW|(s); 

(4) v° is a decreasing word with odd letters from the set DW£(s); 
having the following properties: 

tote = tote' + totf e + totv°: negw = negw' + X(v°): 

(4.1) 

fixw + = A(/); &x~w = \{v°). 
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The bijection (^) i— >• ((^,),v e ,v°) is quite natural to define. Only its 
reverse requires some attention. To get the latter three-term sequence from 
( c ) proceed as follows: 

(a) let li, . . . , l a (resp. mi, . . . , mp) be the increasing sequence of the 
integers U (resp. ra$) such that xi i (resp. x mi ) is a positive (resp. negative) 
fixed point of w; 

(b) define: v e := c h ■ ■ ■ c la and v° := c mi ■ ■ ■ c mf} ; 

(c) remove all the columns ( C!l ), • • • , ( Cla ), ( Cmi ), ■ ■ ■ , ( Cm f) from ( c ) 
and let c be the nonincreasing word derived from c after the removal; 

(d) once the letters xi x , . . . , xi a , x mi , . . . , x m;3 have been removed from 
the signed permutation w the remaining ones form a signed permutation 
of a subset A of [n], of cardinality n — a — /3. Using the unique increasing 
bijection of A onto the interval [n — a — 0\ replace each remaining 
letter X{ by <f>(xi) if Xi > or by — 0(— x^) if x^ < 0. Let w' be the signed 
derangement of order n — a — (3 thereby obtained. 

For instance, with the above weighted signed permutation we have: 
v e = 10, 10, 4, 4 and v° = 7, 3. After removing the fixed point columns we 
obtain: 





4 6 


7 


11 12 




(5 


7 7 


4 


2 2 






6 4 


3 


12 13 





and then 



w 





2 3 


4 


5 6 




(i 


7 7 


4 


2 2 






3 2 


1 


6 7 





There is no difficulty verifying that the properties listed in (4.1) 
hold. For reconstructing (^) from the sequence ((^,), f e , i>°) consider the 
nonincreasing rearrangement of the juxtaposition product v e v° in the form 
■ ■ -6^ m , where b\ > ■ ■ ■ > b m and hi > 1 (resp. foj = 1) if 6^ is even 
(resp. odd). The pair ( ,J being decomposed into matrix blocks, as shown 
in the example, each letter bi indicates where the hi fixed point columns 
are to be inserted. We do not give more details and simply illustrate the 
construction with the running example. 

With the previous example b\ x • • -b^ = 10 2 74 2 3. First, implement 
10 2 : 



then 7: 



/ 1 


2 


3 


4 5 


6 


7 8 




10 10 


9 


7 7 


4 


2 2 


i) 


\ 1 


2 


6 


5 4 


3 


8 9 




1 2 


3 


4 5 6 


7 


8 9 


10 


10 10 


9 


7 7 7 


4 


2 2 


1 


1 2 


7 


6 5 4 


3 


9 10 


8 



notice that because of condition (wsp3) the letter 7 is to be inserted in 
second position in the third block; 
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then insert 4 2 : 



/l 2 


3 


4 5 6 


7 8 9 


10 11 




10 10 


9 


7 7 7 


4 4 4 


2 2 


") 


\1 2 


7 


6 5 4 


3 8 9 


11 12 


10 J 



The implementation of 3 gives back the original weighted signed permu- 
tation ( c ). 

5. Proof of Theorem 1.3 

It is (/-routine (see, e.g., [An76, chap. 3]) to prove the following identi- 
ties, where v\ is the first letter of v: 



(u;q) 



n>0 



'N + n-1 




~N + n~ 


n 




n 



= E > 

1 veNIW n (N) 



tot v . 



(u; q) 



tot v uVl 



«6NIW„ 
,tot v e 



^ = E«" E « to "-i^ E * 

n>0 ueNIW„(JV) 

(5.i) 7 — — = v« n y , 

(^ 2 ) Ls /2] + i ^ „ eeN ^ (s) 

(5-2) {-uq-q\ {s+l)m =Y,u n £ 

n>0 u°6DW°(s) 

The last two formulas and Proposition 4.1 are now used to calculate 
the generating function for the weighted signed permutations. The symbols 
NIW e (s), DW°(s), WSP(s), WSD(s) designate the unions for n > of the 
corresponding symbols with an n-subscript. 

Proposition 5.2. The following identity holds: 

(5.3) q totc Y$ x+w Yf x ~ w Z nesw 
n>o (=)ewsp„(«) 

(u;q 2 ) L ,/2j+i (-uqYiZ;q 2 ) [(s+1)/2i ^ ^ ^ n y^ totCz „ egw 
(uY ;q2) [s/2i+1 {-uqZ-q>) V{8+1)m ^ 

Proof. First, summing over {w e ,w°, (^)) G Niw(s) x DW(s) x WSP(s), 
we have 

u A(u> e )gtot w e x ^^A^^tot u;° x u A(c)^tot cy^fix+ wyfix" w^negw 



(5.4) 



(-uqZ;q 2 ) [{s+1)/2i 

(w; ? 2 )l s /2j+i 



x ^ ^ A(c)^tot cy^fix + uiyiix wgnegi 

C) 



12 



FIXED AND PIXED POINTS 



v ,v 



by (5.1) and (5.2). Now, Proposition 4.1 implies that the initial expression 
can also be summed over five-term sequences ((^,),w e ,tJ ,w e ,w ) from 
WSD(s) x NIW e (s) x DW°(s) x NIW e (s) x DW°(s) in the form 

u HC) q totc' z ne gW ' x ( u y )A(- e ) ? tot^ x \(v°) g tot v° 

(£),v*,v°,w*,w° x u \( w n q totw* x ( uZ ) X ( w °) q totw ° 

= J2( uY o) X(ve) Q t0tv£ x {uY^Zf^q^" 

x u x{c ^q totc 'Z nesw ' x u H™ e ) q tot w * x ( uZ ) x ( w0 ) q totw °. 

The first summation can be evaluated by (5.1) and (5.2), while by 
Proposition 4.1 again the second sum can be expressed as a sum over 
weighted signed permutations (^) G WSP(s). Therefore, the initial sum is 
also equal to 

Identity (5.3) follows by equating (5.4) with (5.5). [] 
Proposition 5.3. The following identity holds: 

(5.6) £V ^ g totc r^=(i-u^^ x(lodd) ) _1 . 

™>o (=)ewsp„( s ) *=o 
Proof. For proving the equivalent identity 



s 



(5.7) J2 q totc Z^ w = (j2q l Z xit0dd) y (n>0) 

U)ewsp n («) 1=0 

it suffices to construct a bijection (^) i— > d of WSP n (s) onto {0, 1, ... , s} n 
such that tot c = tot d and neg w = odd <i. This bijection is one of the main 
ingredients of the MacMahon Verfahren for signed permutations that has 
been fully described in [FoHa05, § 4]. We simply recall the construction of 
the bijection by means of an example. 

Start with f^j = (^^256857/' f° rm the two-matrix 



1097442211 
1 43256897 



, where the negative integers on the bottom row have 
13 
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been replaced by their opposite values. Next, rearrange its columns in such 
a way that the bottom row is precisely 12 . . . n. The word d is defined 

f d\ /]047942121 N 
to be the top row in the resulting matrix. Here ' " 



v idy V 1 23456789 / 

As d is a rearrangement of c, we have tot c = tot d and neg w = odd d. For 
reconstructing the pair (^) from d = d\di • • ■ d n simply make a full use of 
condition (wsp3). 

Using the properties of this bijection we have: 

n 

^totc^-negw _ ^totd^-oddd _ ^ ^d; gX(di odd) 

(^)ewsp„( s ) de{o,i,...,«}» de{o,i,-,«} n *=i 

n 



= n e ^ zx(di odd) = (zy zX(< odd) )- D 



i=ldie{0,l, ...,«} i=0 

Let G n := G n (t, q, Yq, Yi, Z) denote the right-hand side of (1.12) in the 
statement of Theorem 1.3. 

Proposition 5.4. Let G n := G n (t, q, Y$, Y\, Z) denote the right-hand side 
of (1.12) in the statement of Theorem 1.3. Then 

/roN 1 "H t X > s V * „tot Cvfix + U>-lAfix~ W r7neR w 

( ' Q)n+1 °>° U)ewsP„ (s) 

Proof. A very similar calculation has been made in the proof of 
Theorem 4.1 in [FoHa05]. We also make use of the identities on the q- 
ascending factorials that were recalled in the beginning of this section. 
First, 

1+t j2(t 2r ' +t 2r ' +1 ) 



(t 2 ;q 2 )n+i r , >() 



n + r 

ml 



£<f e " 



r>0 



2 tot b 
r>0 &6NIW„([r/2j) 



Then, 
1 + t 



(t 2 ;q 2 ) 



Q ^ ^ f r ^ ^ 2 tot b ^ y ^fdes lii^fmaj it)-^fix + w-^fix m^negi 

n+1 r>0 6eNIW„, wEB n 

26i<r 



^ ^ ^ ^ ^2 tot b+fmaj ui-^fix^ ui-^fix w gneg 



s>0 b6NIW„,weB„ 
2bi+fdes w<s 



As proved in [FoHa05, §4] to each (°) = (^^™) G WSP n (s) there 
corresponds a unique b = b± ■ • - b n E NlW n such that 2&i + fdes w = c\ and 
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2 tot b + fmaj w = tot c. Moreover, the mapping ( c ) i— > (6, w) is a bijection 
of WSP n (s) onto the set of all pairs (6, w) such that b = b\ • • • b n G NlW n 
and w G B n with the property that 2b \ + fdesw < s. 

The word b is determined as follows: write the signed permutation w 
as a linear word w = x\X2 ■ ■ ■ x n and for each k = 1, 2, . . . , n let Zk be the 
number of descents (x, > Xi+i) in the right factor XkXk+i ■ ■ -x n and let tk 
be equal to or 1 depending on whether Xk is positive or negative. Also 
for each k = 1, 2, . . . , n define := (ck — efc)/2, : = (flit — Zfc) and form 
the word b = b\ • • • b n . 

For example, 



Id 


=12345678 


9 


10 


c 


=97744422 


1 


1 


w 


= 43215689 10 


7 


z 


= 11111111 








e 


=1110 


1 


1 


a 


=43322211 








b 


=32211100 









Pursuing the above calculation we get (5.8). [] 
We can complete the proof of Theorem 1.3: 



£(1 + t)G n (t, q, Y , Y ly Z)-^- 

n>0 [t ' Q > n+1 

= V t0t Cy o Rx+ WY i X ~ Wzneg W [by (5-8)] 

S >0 n>0 ^ eWSPn(s) 

= (^;9 2 )l s /2J+i (-nqyi^;q 2 ) L ( s+ i)/ 2 j 

^ (wlo;o 2 ) Ls /2j+i (-wgZ;g 2 ) L ( s +i)/2j 

x o totc ^ negw [by (5.3)] 

n>0 (°)eWSP„(«) 

= E tS ( 1 - w E^ x( ' odd) ) _1 

x /'""1 L ; /2J+1 ( - mY f't)^m [by(5 . 6)] . 

(-uy ;r) Ls /2j+i (-wq^;q 2 ) L ( s +i)/2J 
Hence, G n (£, g, Y , Y u Z) = B n (t, q, Y , Y u Z) for all n > 0. Q 

6. Specializations 

For deriving the specializations of the polynomials e B n (q, Y , Yi, Z) 
and B n (t, q,Y ,Yi, Z) with their combinatorial interpretations we refer 
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to the diagram displayed in Fig. 1. Those two polynomials are now re- 
garded as generating polynomials for B n by the multivariable statistics 
(£, pix + , pix - , neg) and (fdes, fmaj, fix" 1 ", fix - , neg), their factorial generat- 
ing functions being given by (1.7) and (1.9), respectively. 

First, identity (1.8) is deduced from (1.9) by the traditional token that 
consists of multiplying (1.9) by (1 — t) and making t = 1. Accordingly, 
B n (q, Y , Yi, Z) occurring in (1.8) is the generating polynomial for the 
group B n by the statistic (fmaj, fix + , fix - , neg). 

Now, let 

(6.1) B(q, Y , Yi, Z; u) := ]T 2 B n (q, Y , Y u Z). 

n>0 W ,q )n 

The involution of B n defined by w = x\X2 • • -x n \— > w := X1T2 • ■ -x n has 
the following properties: 

(6.2) fmaj w + fmaj IF = n 2 ; neg w + neg IF = n; 

(6.3) fix + w = fix - IF; fix - w = fix + IF. 

Consequently, the duality between positive and negative fixed points must 
be reflected in the expression of B (q, Yq , Y\ , Z\ u) itself, as shown next. 

Proposition 6.1. We have: 

(6.4) B(q, Y , Yi, Z; u) = B{q~\ Y u Y , Z" 1 ; -uq~ x Z). 

Proof. The combinatorial proof consists of using the relations written 
in (6.2), (6.3) and easily derive the identity 

(6.5) B n (q, Y , Y U Z) = q n * Z n B n (q~\ Y u Y , Z -1 ). 

With this new expression for the generating polynomial identity (6.1) 
becomes 

B(q, Yo, Yi, Z-u) = Y, 7~y ^ B n (q-\ Y t , Y , Z -1 ), 

n>0 [Q ' Q )n 

which implies (6.4). 

The analytical proof consists of showing that the right-hand side of 
identity (1.8) is invariant under the transformation 

(q, Y , Y l7 Z, u) » (q-\ Y u Y , Z~\ -uq^Z). 

The factor 1 — u(l + qZ)/(l — q 2 ) is clearly invariant. As for the other 
two factors it suffices to expand them by means of the (/-binomial theorem 
([GaRa90], p. 7) and observe that they are simply permuted when the 
transformation is applied. [] 
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The polynomial D%(t, q, Y u Z) := B n {t, g, 0, Y u Z) (resp. D*{q, Y u Z) 
:= B n (q, 0, Y"i, Z)) is the generating polynomial for the set of 
the signed derangements by the statistic (fdes, fmaj, fix - , neg) (resp. 
(fmaj, fix - , neg)). Their factorial generating functions are obtained by let- 
ting Y = in (1.9) and (1.8), respectively. 

Let Yq = 0, Y\ = 1 in (1.8). We then obtain the factorial generating 
function for the polynomials D%(q,Z) := £ g fmaj w Z ne z w (w E D%) in 
the form 

u n / 1 4- aZ\ ~ 1 

( 6 - 6 ) zZj^v D n^ z ) = ( 1 - u Y^2) x(«;? 2 )oo. 
n>0 [q ,q )n v i g / 



It is worth writing the equivalent forms of that identity: 



/ 2 2\ n 



£>£(g,Z) (n>0); 



(6.8) D*(q,Z) = Y^ 



k=0 



(g )"-* (! + gZ )"- fc (n>0); 

Q 2 (i - <rr 



and for n > 



(6.9) D*(q,Z) = \ 

1 _ „2n+2 

^n + l(g, Z) = (1 + gS) / 2 ^(g, + 

1 — g z 

(6.10) L>^(g, Z) = 1, Df (g, Z) = Zg, and for n > 1 



D* +1 (q,Z) = 



\ _ ^2n ^ _ ^2n+2 



1-g 2 



+ gZ- 



1-g 2 



+ (l + gZ)g 



2n 



1-g 
1 - g 2 



2n 



-^n-l(g^)- 



Note that (6.8) is derived from (6.6) by taking the coefficients of u n on 
both sides. Next, multiply both sides of (6.6) by the second g 2 -exponential 
E q 2 (—u) and look for the coefficients of u n on both sides. This yields (6.7). 
Now, write (6.6) in the form 



(6.11) 



M-») = (i-«£f)E 



u' 



n>0 



(M, DBjq ' Z) 



and take the coefficients of u n on both sides. This yields (6.9). Finally, 
(6.10) is a simple consequence of (6.9). 

When Z = 1, formulas (6.6), (6.8), (6.9) have been proved by Chow 
[Ch06] with D%(q) = J2 W g fmaj ™ (weD%). 
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Now the polynomial K^(q, Yi, Z) £ B n (q, 0, Y"i, Z) is the generating 
polynomial for the set of the signed des arrangements by the statistic 
(£, pix~, neg). From (1.7) we get 



q (-Zg;g) n (g;g) ? 



o (-Zg;g) n (g;g) n 

When the variable Z is given the zero value, the polynomials in the 
second column of Fig. 1 are mapped on generating polynomials for the 
symmetric group, listed in the third column. Also the variable Y"i vanishes. 
Let A n (t, q, Y ) := B n (t x l 2 , q 1 ' 2 , Y , 0, 0). Then 

(6.13) A n (t,q,Y )= t des ^ maj< % W (nx:=fix + ). 
Identity (1.9) specializes into 

(6.14) £ A n (t, q, Y ) = £* S (l-«X> 1 ) " V^V 1 ' 

an identity derived by Gessel and Reutenauer ([GeRe93], Theorem 8.4) 
by means of a quasi-symmetric function technique. Note that they wrote 
their formula for "1 + des" and not for "des." 

Multiply (6.14) by (1 — t) and let t := 1, or let Z := and q 2 be replaced 
by q in (1.8). Also, let A n (q,Y ) := ^ ff ^j ff yfl Xff ^ e we get 

(6.15) YJ^L^.n)^!-^)"'^^, 
^ {Q;Q)n V 1-qJ (w>o;9)oo 

an identity derived by Gessel and Reutenauer [GeRe93] and also by Clarke 

et al. [ClHaZe97] by means of a g-Seidel matrix approach. 

We do not write the specialization of (6.14) when Y : = to obtain 

the generating function for the polynomials D n {t,q) := Yl t desa q m ^ a . 

<?eD n 

As for the polynomial D n (q) := q> ma j°", it has several analytical 

cr£-D„ 

expressions, which can all be derived from (6.7)-(6.10) by letting Z : = 
and q 2 being replaced by q. We only write the identity which corresponds 
to (6.7) 



(6.16) D {q) = l and ^k. = £ 



D k (q) for n > 1, 

Q 



which is then equivalent to the identity 
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The specialization of (6.8) for Z := and q 2 replaced by q was originally 
proved by Wachs [Wa98] and again recently by Chen and Xu [ChXu06]. 
Those two authors make use of the now classical MacMahon Verfahren, 
that has been exploited in several papers and further extended to the case 
of signed permutation, as described in our previous paper [FoHa05] . 

In the next proposition we show that D n (q) can be expressed as a 
polynomial in q with positive integral coefficients. In the same manner, 
the usual derangement number d n is an explicit sum of positive integers. 
To the best of the authors' knowledge those formulas have not appeared 
elsewhere. 

Proposition 6.2. The following expressions hold: 

( 6.18) A,( 9 )= e \vr ( c^'-^' tm+t(;)x( " ewa) - 

(6.19) d n = (2/c)(2A; + 2) n _ 2fc _ 1 + x(n even). 

2<2fc<n-l 

Proof. When q = 1, then (6.18) is transformed into (6.19). As for 
(6.18), an easy (/-calculation shows that its right-hand side satisfies (6.9) 
when Z = and q replaced by q 1 ! 2 . [] 

Now, let inv A n (q, Y ) := £ B n (q, Y , 0, 0). Then 

(6.20) in M n ( ? ,y )= £ q^Yt a (pix:=pix+). 

o-es„ 

Formula (1.7) specializes into 

(6.21) E 7 ^ r '"M„( 9 ,Fo)=(l- T ^)" 7 ^%; 

In view of (6.15) we conclude that 

(6.22) A n (q,Y ) = inv A n (q,Y ). 

For each permutation a = o~(l) ■ ■ -a(n) let the ligne of route of a be 
defined by Ligne a := {i : a(i) > a(i + 1)} and the inverse ligne of route 
by Ilignea := Lignecr -1 . Notice that maj a = J^i^xi^ £ Lignecr); we 
also let imaja := J2i * x(i e Ilignea). Furthermore, let i : a t— > a -1 . 
If $ designates the second fundamental transformation described in [Fo68] , 
[FoSc78], it is known that the bijection \1/ := i $ i of & n onto itself has the 
following property: (Ligne, imaj) a = (Ligne, inv) ^(o~). Hence, 

(6.23) (pix, imaj) a = (pix, inv) ^(a) 
and then A n (q, Y ) has the other interpretation: 

(6.24) A n (q,Y )= £ ^ajaypixa 
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Finally, let K n (?) := ? inv ^ Then, with Y" := in (6.22) we have: 

(6.25) K n (q) = ™A n (q,0) = A n {q,0) = D n {q). 

However, it can be shown directly that K n (q) is equal to the right-hand 
side of (6.18), because the sum occurring in (6.18) reflects the geometry 
of the desarrangements. The running term is nothing but the generating 
polynomial for the desarrangements of order n whose leftmost trough is 
at position 2k by the number of inversions "inv." 
The bijection $ also sends K n onto itself, so that 

(6.26) J2 3 inV<J = J2 3 imajfJ ' 

a result obtained in this way by Desarmenien and Wachs [DeWa90, 93], 
who also proved that for every subset E C [n — 1] we have 

(6.27) #{a e D n : Lignea = E} = #{a G K n : Ilignea = E}. 
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